Randomized page weights for optimizing buffer pool page reuse

ABSTRACT

In general, the disclosure is directed to techniques for choosing which pages to evict from the buffer pool to make room for caching additional pages in the context of a database table scan. A buffer pool is maintained in memory. A fraction of pages of a table to persist in the buffer pool are determined. A random number is generated as a decimal value of 0 to 1 for each page of the table cached in the buffer pool. If the random number generated for a page is less than the fraction, the page is persisted in the buffer pool. If the random number generated for a page is greater than the fraction, the page is included as a candidate for eviction from the buffer pool.

TECHNICAL FIELD

The disclosure relates to memory management, more specifically toselecting data to evict from a buffer pool.

BACKGROUND

A database is made up of database tables, and database tables of thedatabase can be divided into pages. A buffer pool acts as a cache for adatabase and can cache pages of database tables. A client can requestaccess to pages of the database, such as by performing a table scan of adatabase table in the database. If a requested page is cached in thebuffer pool, then that page can be accessed by the client without havingto physically access the database on secondary storage. However, if arequested page is not cached in the buffer pool, the page must be loadedfrom secondary storage (i.e. hard disk drives), and placed in the bufferpool. If the buffer pool is full, then pages are evicted to make room inthe buffer pool to cache the requested page.

A client can perform a database table scan to access every page of aspecific database table. In situations where the amount of pages of thedatabase table exceeds the capacity of the buffer pool, currenttechniques for evicting pages from the buffer pool may lead to poor pagereuse in the buffer pool. For example, given a database table made up ofsix pages and a buffer pool with a capacity of three pages, the bufferpool may first cache the first page, the second page, and the third pageof the six-page database table. Because the buffer pool is now full, anadditional page cannot be cached in the buffer pool without firstevicting a page from the buffer pool.

A least recently used (LRU) algorithm, which evicts the least recentlyused page from the buffer pool, is a typical algorithm for determiningwhich pages to evict form the buffer pool. After the first three pagesof the database table are cached in the buffer, the LRU algorithm evictsthe first page to store the fourth page into the buffer pool, thenevicts the second page to store the fifth page into the buffer pool, andfinally evicts the third page to cache the sixth page into the bufferpool. After the database table scan finishes, the buffer pool willcontain the fourth page, the fifth page, and the sixth page of thedatabase table.

If the client re-scans the same database table, no page reuse occursbecause none of the first three pages accessed during the re-scan (i.e.,the first page, the second page, and the third page) are cached in thebuffer pool, and evicting the fourth page, the fifth page, and the sixthpage from the buffer pool to cache the first page, the second page, andthe third page into the buffer pool leads to no page reuse in the bufferpool when the fourth page, the fifth page, and the sixth page of thedatabase table is being accessed during the course of the re-scan.

SUMMARY

In general, the disclosure is directed to techniques for choosing whichpages to evict from the buffer pool to make room for caching additionalpages in the context of a database table scan. The goals of thetechniques disclosed herein may include achieving a reasonable amount ofpage reuse if a database table scan is immediately repeated, preservingas much of the existing pages cached in the buffer pool as possible suchthat only a small amount of pages are evicted from the buffer pool inthe case of the database table scan never being repeated, and achievingnear-optimal page reuse if the same database table scan is repeated acertain number of times.

Instead of attempting to cache every page of a database table in thebuffer pool, the techniques disclosed herein may attempt to persist inthe buffer pool a subset of the pages in the database table. Forexample, given a buffer pool capacity of 10,000 pages and a databasetable size of 100,000 pages, the buffer pool can persist no more than10% (i.e., no more than 10,000 pages) of the database table.Furthermore, because a database likely contains more than one databasetable, each of which may be scanned at some point, a single databasetable should not be able to take over a large portion of the entirebuffer pool unless the single database table has been scanned severaltimes in recent history, or if it is certain that the single databasetable will repeatedly be re-scanned. Thus, for a single database table,the amount of pages initially persisted in buffer pool may make up nomore than 20%-50% of the capacity of the buffer pool. To determine thefraction of pages of the database table to persist in the buffer pool,the fraction of pages in the database table that can be cached in thebuffer pool is multiplied by the fraction of the buffer pool allottedfor pages of the database table to determine the fraction of pages ofthe database table to be persisted in the buffer pool. For example, ifit is determined for a database table having a size of 100,000 pages anda buffer pool having a capacity of 10,000 pages that the amount of pagespersisted in the buffer pool should make up approximately 20% of thecapacity of the buffer pool, then the fraction of pages of the databasetable to be persisted in the buffer pool may be 0.1 (10,000/100,000)multiplied by 0.2 (20%), which equals 0.02 (i.e., 2%).

As a database table is being scanned, pages of the database table can becached in the buffer pool, and the client scanning the database tablecan access the pages in the buffer pool. After the pages are accessed bythe client, a decision can be made whether to persist the pages in thebuffer pool so that the pages remain in the buffer pool after theconclusion of the database table scan. After a page is accessed by theclient, a random number having a decimal value (between 0 and 1) isgenerated for that page. If the value of the random number is smallerthan the fraction of pages of the database table to persist in thebuffer pool, then the page is persisted in the buffer pool. Conversely,if the value of the random number is larger than the fraction of pagesof the database table to persist in the buffer pool, then the page isincluded as a candidate for eviction from the buffer pool.

In one aspect, the disclosure is directed to a method. The method mayinclude maintaining a buffer pool in memory. The method may furtherinclude determining a fraction of pages of a table to persist in thebuffer pool. The method may further include generating a random numberas a decimal value in a range of 0 to 1 for each page of the tablecached in the buffer pool. The method may further include, if the randomnumber generated for a page is less than the fraction, persisting thepage in the buffer pool. The method may further include, if the randomnumber generated for the page is greater than the fraction, includingthe page as a candidate for eviction from the buffer pool.

In another embodiment, the disclosure is directed to a computer-readablestorage medium containing instructions. The instructions may cause aprogrammable processor to maintain a cache. The instructions may furthercause a programmable processor to determine a fraction of objects of amemory to persist in the cache. The instructions may further cause aprogrammable processor to generate a random number as a decimal value ina range of 0 to 1 for each object of the memory cached in the cache. Theinstructions may further cause a programmable processor to, if therandom number generated for an object is less than the fraction, persistthe object in the cache. The instructions may further cause aprogrammable processor to, if the random number generated for the objectis greater than the percentage, include the object as a candidate foreviction from the cache.

In another aspect, the disclosure is directed to a computing system. Thecomputing system may include a processor. The computing system mayfurther include memory. The computing system may further include abuffer pool maintained in the memory. The computing system may furtherinclude a buffer management module operable by the processor andconfigured to: determine a fraction of pages of a table to persist inthe buffer pool; generate a random number as a decimal value in a rangeof 0 to 1 for each page of the table cached in the buffer pool; if therandom number generated for a page is less than the fraction, persistthe page in the buffer pool; and if the random number generated for thepage is greater than the fraction, include the page as a candidate foreviction from the buffer pool.

In another aspect, the disclosure is directed to a method. The methodmay include maintaining a cache. The method may further includedetermining a fraction of objects of a memory to persist in the cache.The method may further include persisting in the cache an amount ofobjects of the memory based on the determined fraction of objects of thememory to persist in the cache. The method may further include includingas candidates for eviction from the cache one or more objects of thememory in the cache that are not included in the amount of objects.

The details of one or more embodiments of the invention are set forth inthe accompanying drawings and the description below. Other features,objects, and advantages of the invention will be apparent from thedescription and drawings, and from the claims.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1A is a block diagram illustrating an example computing systemaccording to some aspects of the present disclosure.

FIG. 1B is a block diagram illustrating an example technique forselecting victim pages for a buffer pool according to aspects of thepresent disclosure.

FIG. 1C is a block diagram illustrating a buffer pool after evictingpages listed in the victim list according to aspects of the presentdisclosure.

FIG. 2 is a flowchart illustrating an example method for selectingvictim pages in a buffer pool according to aspects of the presentdisclosure.

FIG. 3 is a chart illustrating page reuse in multiple iterations oftable scans according to aspects of the disclosure.

FIG. 4 is a chart illustrating the amount of physical accesses to adatabase in a baseline page eviction scheme compared to the pageeviction scheme disclosed herein according to aspects of the presentdisclosure.

FIG. 5 is a chart illustrating the total amount of physical accesses toa database of the queries shown in FIG. 4 according to aspects of thedisclosure.

DETAILED DESCRIPTION

As will be appreciated by one skilled in the art, aspects of the presentdisclosure may be embodied as a system, method or computer programproduct. Accordingly, aspects of the present disclosure may take theform of an entirely hardware embodiment, an entirely software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit,” “module” or “system.”Furthermore, aspects of the present disclosure may take the form of acomputer program product embodied in one or more computer readablemedium(s) having computer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: an electrical connectionhaving one or more wires, a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,a portable compact disc read-only memory (CD-ROM), an optical storagedevice, a magnetic storage device, or any suitable combination of theforegoing. In the context of this document, a computer readable storagemedium may be any tangible medium that can contain, or store a programfor use by or in connection with an instruction execution system,apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmittedusing any appropriate medium, including but not limited to wireless,wireline, optical fiber cable, RF, etc., or any suitable combination ofthe foregoing.

Computer program code for carrying out operations for aspects of thepresent disclosure may be written in any combination of one or moreprogramming languages, including an object oriented programming languagesuch as Java, Smalltalk, C++ or the like and conventional proceduralprogramming languages, such as the “C” programming language or similarprogramming languages. The program code may execute entirely on theuser's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

Aspects of the present disclosure are described below with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems) and computer program products according to embodiments of thedisclosure. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general purpose computer, specialpurpose computer, or other programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable data processingapparatus, create means for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

FIG. 1A is a block diagram illustrating an example computing systemaccording to some aspects of the disclosure. As shown in FIG. 1A,computing system 100 may include database 102, buffer pool 104, client106, victim list 108, and buffer management module 110. Client 106 mayperform a table scan on database 102. Pages of the database table beingscanned may be cached in buffer pool 104. As further table scans areperformed on database 102, additional pages of database tables may bestored in buffer pool 104. As buffer pool 104 becomes full, pages may beevicted from buffer pool 104. Pages that are candidates for evictionfrom buffer pool 104 may be listed in victim list 108.

Computing system 100 may include one or more computing devices havingone or more processors 160, including but not limited to one or moreserver devices and/or the cloud. Client 106 may be an application storedin memory 150 of computing system 100 that is operable by one or moreprocessors 160 to access database 102 and buffer pool 104.

Computing system 100 may include storage device 140 and memory 150.Memory 150, in one example, is configured to store information withincomputing system 100 during operation. Memory 150, in some examples, isdescribed as a computer readable storage medium. In some examples,memory 150 is a temporary memory, meaning that a primary purpose ofmemory 150 is not long-term storage. Memory 150, in some examples, isdescribed as a volatile memory, meaning that memory 150 does notmaintain stored contents when computing device 100 is turned off.Examples of volatile memories may include random access memories (RAM),dynamic random access memories (DRAM), static random access memories(SRAM), and other forms of volatile memories known in the art. In someexamples, memory 150 is used to store program instructions for executionby processors 160. Memory 150, in one example, is used by software orapplications running on computing system 100 to temporarily storeinformation during program execution.

Storage devices 140 in some examples, also includes one or more computerreadable storage media. Storage devices 140 may be configured to storelarger amounts of information than memory 150. Storage devices 140 mayfurther be configured for long-term storage of information. In someexamples, storage devices 140 include non-volatile storage elements.Examples of such non-volatile storage elements may include magnetic harddiscs, optical discs, floppy discs, flash memories, or forms ofelectrically programmable memories (EPROM) or electrically erasable andprogrammable (EEPROM) memories.

Computing system may also include one or more processors 160, which maybe one or more programmable processors that are operable to executeinstructions stored on storage device 140 and memory 150.

Database 102 is any organized collection of data and may be maintainedin storage device 140 of computing system 100. Data in database 102 isorganized into database tables 130A-130Z (“tables 130”), and each tablein tables 130 is made up of pages 132A-132N “pages 132”). In someexamples, data in tables 130 are organized into rows and columns, and apage of a table, in some examples, includes one or more rows of thedatabase table or one or more column values.

Buffer pool 104 is be maintained in memory 150 of computing system 100and is operable to cache pages 132 of database tables 130 in database102. For example, if client 106 sends a read request for a page of adatabase table in database 102, the requested page is placed in bufferpool 104. If client 106 subsequently makes another request for a page ofa database table in database 102, buffer pool 104 is checked for thatrequested page. If the requested page is cached in buffer pool 104, therequested page is accessed from buffer pool 104 without having tophysically access database 102. Cached pages 120A-120M (“cached pages120”) may each include a page randomly saved bit out of page randomlysaved bits 124A-124M and may be associated with a weight out of weights122A-122M. The weight associated with a cached page is either zero ornon-zero, and the page randomly saved bit for the cached page is 1 ifthe associated weight is non-zero and is 0 if the associated weight iszero.

Victim list 108 may be maintained in memory 150 and includes a list ofone or more pages that are candidates for eviction (e.g., victims) frombuffer pool 104. If buffer pool 104 is full, buffer pool 104 is not ableto cache an additional page without evicting a currently-cached page,and the page to be evicted from buffer pool 104 is chosen from the pageslisted in victim list 108.

Buffer management module 110 manages buffer pool 104. Buffer managementmodule 110 may optimize page reuse within buffer pool 104, includingdetermining which pages to retain in buffer pool 104 and which pages canbe evicted from buffer pool 104. If it can be predicted that the sametable scan of the database table having pages cached in buffer pool 104will be repeatedly performed, then the pages of that database table mayremained cached in buffer pool 104. Conversely, if it can be predictedthat the same table scan of the database table having pages cached inbuffer pool 104 will not be performed again, then the pages of thedatabase table should be evicted from buffer pool 104. However, becauseit is difficult to predict the future access patterns for a givendatabase table, buffer management module 110 optimizes page reuse bypersisting a specified amount of pages of the database table in bufferpool 104 and including the other pages of the database table cached inbuffer pool 104 as candidates for eviction from buffer pool 104.

Buffer management module 110 determines the percentage pages of aspecific database table that can be cached at the same time in bufferpool 104. For example, given a capacity of 10,000 pages for buffer pool104 and a database table size of 100,000 pages, the maximum percentageof pages of the database table that can be cached at the same time inbuffer pool 104 is 10% (i.e., 10,000 pages). The 10% of the pages in thedatabase table that can be cached at the same time in buffer pool 104can be considered the optimal percentage of the pages in the databasetable.

To prevent pages from a single database table from monopolizing bufferpool 104, buffer management module 110 determines, for a table scan, thepercentage of space in buffer pool 104 that is allocated for retainingpages of the database table. This percentage can also be expressed as apercentage of the optimal percentage of the pages in the database tablebecause, as discussed above, the optimal percentage of the pages in thedatabase table indicates the percentage of the pages in the databasetable that can be cached at the same time in buffer pool 104. In someexamples, the percentage of the optimal percentage is approximately 20%to 50%, and the percentage of the optimal percentage can bepre-specified or can be dynamically determined and readjusted based onfeedback from previous database table scans.

Buffer management module 110 optimizes page reuse in buffer pool 104 bypersisting a specified percentage of the pages of the database table inbuffer pool 104 and marking the rest of the pages of the database tableas candidates for eviction from buffer pool 104. The percentage of pagesin the database table to retain in buffer pool 104 is determined bymultiplying the optimal percentage of the pages in the database table bya percentage of the optimal percentage. To that end, buffer managementmodule 110 generates, for each page of the database table cached inbuffer pool 104, an associated random number as a decimal value in arange of 0 to 1. If the random number generated for a page is less thanthe fraction of pages of the database table to persist in buffer pool104, then buffer management module 110 persists the page in buffer pool104, including associating the page with a non-zero weight. For example,the non-zero weight associated with the page may be the same number forall pages associated with a non-zero weight. The non-zero weightassociated with the page may also be different for each page. On theother hand, if the random number generated for the page is greater thanthe percentage of pages of the database table to persist in buffer pool104, then buffer management module 110 includes the page as a candidatefor eviction from the buffer pool, including associating the page with azero weight and adding the page to victim list 108. In other examples,if the random number generated for a page is less than the fraction ofpages of the database table to persist in buffer pool 104, instead ofassociating the page with a non-zero weight, the associated pagerandomly saved bit 124 may be set to 1. As discussed above, pages thatare candidates for eviction are listed in victim list 108, and the pagesto be evicted from buffer pool 104 are chosen from the pages listed invictim list 108 provided that victim list 108 is not empty. In someexamples, the random number generated for pages may also be weighedbased on the cost of accessing those pages from database 102, so thatthe random number generated for a page may be weighed towards persistingthe page in buffer pool 104 (e.g., by weighing the random numbergeneration towards generating a number on the lower end of the range) ifthe cost of accessing the page from database 102 is very high (e.g.,above a specified threshold).

The percentage of the optimal percentage can be adjusted based onfeedback regarding the reuse rate of pages cached in buffer pool 104.Each page associated with a non-zero weight (i.e., pages that are to beretained in buffer pool 104) has a corresponding page randomly saved bitset to 1, indicating that the page is associated with a non-zero weight.Retained pages counter 114 keeps track of the number of retained pagesby incrementing itself for each association of a page of the databasetable with a non-zero weight, or each time an associated page randomlysaved bit of a page turns on, due to the random number generated bybuffer management module 110. Reuse counter 112 keeps track of thenumber of occurrences of reuse of retained pages. If a page of thedatabase table retained in buffer pool 104 is reused, the page isexamined to determine if the page randomly saved bit is set to 1 and, ifso, reuse counter 112 is incremented to indicate that page reuseoccurred. The efficacy of page reuse for buffer pool 104 is calculatedby dividing reuse counter 112 by retained pages counter 114. If theefficacy of page reuse for buffer pool 104 does not fall within anspecified range, then the amount of pages of the database table beingscanned that can be stored in buffer pool 104 may be adjusted upwards ordownwards to cause the efficacy of page reuse for buffer pool 104 tofall within the specified range. For example, if the efficacy of pagereuse for buffer 104 is below the specified range, then the percentageof the optimal percentage may be decreased so that fewer pages from thedatabase table are retained in buffer pool 104. Conversely, if theefficacy of page reuse for buffer 104 is above the specified range, thenthe percentage of the optimal percentage may be increased so that morepages from the database table are retained in buffer pool 104. In otherexamples, the percentage of the optimal percentage can also be adjustedbased on a likelihood of the table being scanned again. The likelihoodmay be specified by user input or may be determined based on past accesspatterns of the database table. If the table is not likely to be scannedagain, then the percentage of the optimal percentage may be set to zeroor close to zero.

In some examples, buffer pool 104 may be a cache in computing system 100that may cache objects besides pages of database tables. Instead, bufferpool 104 may be able to cache any objects or files that are stored inmemory of computing system 100. Those objects, like pages 120, may beassociated with page randomly saved bits 124 and weights 122A. Similarto what is described above, buffer pool 104 can optimize object reuse bypersisting a specified percentage of the objects from memory in bufferpool 104 and marking the rest of the objects in memory as candidates foreviction from buffer pool 104. The percentage of objects in memory toretain in buffer pool 104 is determined by multiplying the optimalpercentage of the objects in memory by a percentage of the optimalpercentage. To that end, buffer management module 110 generates, foreach objects in memory that is cached in buffer pool 104, an associatedrandom number as a decimal value in a range of 0 to 1. If the randomnumber generated for an object is less than the fraction of objects ofthe memory to persist in buffer pool 104, then buffer management module110 persists the object in buffer pool 104, including associating theobject with a non-zero weight. On the other hand, if the random numbergenerated for the object is greater than the percentage of objects ofthe memory to persist in buffer pool 104, then buffer management module110 includes the object as a candidate for eviction from the bufferpool, including associating the object with a zero weight and adding theobject to victim list 108. In other examples, if the random numbergenerated for a page is less than the fraction of objects of the memoryto persist in buffer pool 104, instead of associating the object with anon-zero weight, an associated page randomly saved bit 124 may be set to1.

In some examples, instead of randomizing the pages or objects to persistor evict from buffer pool 104, the first N number of pages or objectsmay be persisted or evicted from buffer pool 104. For example, if adatabase table being scanned includes 30 pages, if buffer pool 104 has acapacity of 3 pages and currently caches 3 pages, and if the optimalpercentage of pages in the database table to persist in buffer pool 104is 10%, then the percentage of the optimal percentage is 33%, so thatthe buffer pool is designed to persist one of the pages of the databasetable. Instead of randomizing which pages to evict from buffer pool 104,the first two pages from the database table that is encountered may beevicted from buffer pool 104. Alternatively, the first page from thedatabase table that is encountered may be persisted in buffer pool 104,and the rest of the pages from the database table may be evicted (e.g.,put on victim list 108).

FIG. 1B is a block diagram illustrating an example technique forselecting victim pages for a buffer pool according to aspects of thepresent disclosure. In the example shown in FIG. 1B, a database tablebeing scanned includes 30 pages. Buffer pool 104 has a capacity of 3pages and currently caches three pages: page 172, page 174, and page176. Thus, the optimal percentage of pages in the database table topersist in buffer pool 104 is 10%. The percentage of the optimalpercentage is 33%, so that buffer pool 104 is designed to persist one ofthe pages of the database table. The percentage of pages of the databasetable to persist in the buffer pool is 10% multiplied by 33%, whichequals 0.033 (i.e. 0.33%).

A random number between 0 and 1 is generated for each of the pages 172,174, and 176. If the random number generated for a page is less than 10%multiplied by 33%, which is 0.033, then the page's page randomly savedbit is turned on (i.e. set to 1). If the random number generated for thepage is larger than 0.033, then the page's page randomly saved bitremains off (i.e. remains at 0). Because the random number generated forpage 172 is 0.02, which is less than 0.033, page 172's page randomlysaved bit is turned on. However, because the random number generated forpage 174 is 0.7, and because the random number generated for page 176 is0.4, which are both larger than ⅓, both pages 172's and 174's pagerandomly saved bit 124 remain turned off. Because pages 174 and 176 areassociated with a page randomly saved bit that is turned off, they areadded to victim list 108 as candidates for eviction from buffer pool104.

FIG. 1C is a block diagram illustrating a buffer pool after evictingpages listed in the victim list according to aspects of the presentdisclosure. As shown in FIG. 1C, if buffer pool 104 needs to evict pagesfrom the pool in order to make room for caching additional pages, thenthe pages evicted from buffer pool 104 are pages that are listed invictim list 108. Because pages 174 and 176 are listed in victim list104, those two pages may be the pages that are evicted from buffer pool104 if the buffer pool 104 is to cache two additional pages 178 and 180.Because page 172 is not listed in victim list 104, page 172 may not beevicted from buffer pool 104 before the pages in victim list 104 areevicted from buffer pool 104.

FIG. 2 is a flowchart illustrating an example method for selectingvictim pages in a buffer pool according to aspects of the presentdisclosure. The method may be performed by, for example, the componentsof computing system 100 shown in FIG. 1. As shown in FIG. 2, computingsystem 100 may maintain buffer pool 104 in memory (e.g., volatilememory) (202). Because the buffer pool 104 is maintained in memory, andbecause database 102 may be maintained on slower storage mediums such asdisks, tape drives, and magneto-optical media, the buffer pool 104 mayprovide faster access to pages cached in buffer pool 104 compared toaccessing pages in database 102.

Buffer management module 110 can determine a percentage of pages of adatabase table to persist in buffer pool 104 (204). In some examples,buffer management module 110 may determine a first percentage pages of adatabase table that can be persisted in buffer pool 104, determine asecond percentage of the first percentage of pages, and multiply thefirst percentage by the second percentage to determine the percentage ofpages of the database table to persist in buffer pool 104. In someexamples, determining the second percentage of the first percentage ofpages is based at least in part on feedback from a previous page reuserate of the buffer pool.

Buffer management module 110 can generate a random number as a decimalvalue in a range of 0 to 1 for each page of the database table cached inbuffer pool 104 (206). If the random number generated for a page is lessthan the fraction of pages of the database table to persist in bufferpool 104, buffer management module 110 can persist the page in bufferpool 104 (208), including associating the page with a non-zero weight.On the other hand, if the random number generated for the page isgreater than the fraction of pages of the database table to persist inbuffer pool 104, buffer management module 110 can include the page as acandidate for eviction from buffer pool 104 (212), including associatingthe page with a zero weight and adding the page to a victim list.

In some examples, associating the page with a non-zero weight mayfurther include marking the page with a bit indicating that the page isassociated with the non-zero weight and incrementing a first counterindicating that the page is associated with the non-zero weight. In someexamples, the method may further include determining that a reused pagefound in the buffer pool is associated with the non-zero weight and,responsive to determining that the reused page is associated with thenon-zero weight, incrementing a second counter to indicate that pagereuse occurred. In some examples, the method may further includedetermining whether a value of hits on pages with non-zero weightsdivided by a total amount of pages with non-zero weights falls within apredefined range and, responsive to determining that the value does notfall within the predefined range, modifying the second amount of pagesthat is cached in the buffer pool. In some examples, the process mayfurther include determining a likelihood of the table being re-scannedand adjusting the fraction of pages of the table to persist in thebuffer pool based on the determined likelihood. In some examples,generating a random number as a decimal value in a range of 0 to 1 foreach page of the table cached in the buffer pool may further includedetermining, for a page of the table, a cost of accessing the page fromthe table and generating a weighted random number based on the coast ofaccessing the page from the table. In some examples, persisting the pagein the buffer pool may include setting a page randomly saved bitassociated with the page.

FIG. 3 is a chart illustrating page reuse in multiple iterations oftable scans according to aspects of the disclosure. Consecutive tablescans may be performed on table 1, table 2, table 3, and table 4 of adatabase, such as database 102, and the consecutive table scans of thosefour tables may be repeatedly performed. The combined size of the fourtables may be 195,000 pages, and the buffer pool, such as buffer pool104, may have a capacity of 30,000 pages. As shown in FIG. 3, the tablescans of those four tables may be performed 13 times, and page reuse maybegin with the second iteration of scanning the four tables. Insubsequent iterations, the buffer pool may provide good page reuse,including almost 30,000 pages in iterations 6 and 11, which is close tothe capacity of the buffer pool, meaning that almost every page in thebuffer pool is reused during those specific iterations.

FIG. 4 is a chart illustrating the amount of physical accesses to adatabase, such as database 102, in a baseline page eviction scheme(e.g., least recently used page eviction scheme) compared to the pageeviction scheme disclosed herein according to aspects of the presentdisclosure. Typically, more page reuse in the buffer pool may lead todecreased physical accesses to the corresponding database, because thepage to be accessed is already in the buffer pool. As shown in FIG. 4,over the course of 59 queries, the database is physically accessed muchless under the page eviction scheme disclosed herein compared to thebaseline page eviction scheme due to better page reuse in the bufferpool of the victim selection scheme disclosed herein.

FIG. 5 is a chart illustrating the total amount of physical accesses toa database of the queries shown in FIG. 4 according to aspects of thedisclosure. As shown in FIG. 4, over the 59 queries, the baseline pageeviction scheme physically accesses the database almost twice as much asthe page eviction scheme disclosed herein.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods and computer program products according to variousembodiments of the present disclosure. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It should also be notedthat, in some alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be executed substantiallyconcurrently, or the blocks may sometimes be executed in the reverseorder, depending upon the functionality involved. It will also be notedthat each block of the block diagrams and/or flowchart illustration, andcombinations of blocks in the block diagrams and/or flowchartillustration, can be implemented by special purpose hardware-basedsystems that perform the specified functions or acts, or combinations ofspecial purpose hardware and computer instructions.

The descriptions of the various embodiments of the present disclosurehave been presented for purposes of illustration, but are not intendedto be exhaustive or limited to the embodiments disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the describedembodiments. The terminology used herein was chosen to best explain theprinciples of the embodiments, the practical application or technicalimprovement over technologies found in the marketplace, or to enableothers of ordinary skill in the art to understand the embodimentsdisclosed herein.

1-11. (canceled)
 12. A computer-readable storage medium comprisinginstructions that cause a programmable processor to: maintain a cache;determine a fraction of objects of a memory to persist in the cache;generate a random number as a decimal value in a range of 0 to 1 foreach object of the memory cached in the cache; if the random numbergenerated for an object is less than the fraction, persist the object inthe cache; and if the random number generated for the object is greaterthan the fraction, include the object as a candidate for eviction fromthe cache.
 13. The computer-readable storage medium of claim 12, whereinpersist the object in the cache comprises: associate the object with anon-zero weight.
 14. The computer-readable storage medium of claim 13,wherein include the object as a candidate for eviction from the cachecomprises: associate the object with a zero weight; and add the objectto a victim list, wherein objects to be evicted from the cache arechosen from objects in the victim list.
 15. The computer-readablestorage medium of claim 14, wherein determine a fraction of objects of amemory to persist in the cache comprises: determine a first fraction ofobjects of the memory that can be persisted in the cache; determine asecond fraction of the first fraction of objects; and multiply the firstfraction with the second fraction.
 16. The computer-readable storagemedium of claim 15 wherein the second percentage of the first fractionof objects is determined based at least in part on feedback from aprevious object reuse rate of the cache.
 17. The computer-readablestorage medium of claim 16, wherein associate the object with a non-zeroweight further comprises: mark the object with a bit indicating that theobject is associated with the non-zero weight; and increment a firstcounter indicating that the object is associated with the non-zeroweight.
 18. The computer-readable storage medium of claim 17, whereinthe instructions further cause the programmable processor to: determinethat a reused object found in the cache is associated with the non-zeroweight; and responsive to determining that the reused object isassociated with the non-zero weight, increment a second counter toindicate that object reuse occurred.
 19. The computer-readable storagemedium of claim 18, wherein the instructions further cause theprogrammable processor to: determine whether a value of hits on objectswith non-zero weights divided by a total amount of objects with non-zeroweights falls within a predefined range; and responsive to determiningthat the value does not fall within the predefined range, modify thesecond amount of objects that is cached in the cache.
 20. Thecomputer-readable storage medium of claim 12, further comprising:determine a likelihood of the memory being re-scanned; and adjust thefraction of objects of the memory to persist in the cache based on thedetermined likelihood.
 21. The computer-readable storage medium of claim12, wherein generate a random number as a decimal value in a range of 0to 1 for each object of the memory cached in the cache furthercomprises: determine, for an object of the memory, a cost of accessingthe object from the memory; and generate a weighted random number basedon the cost of accessing the object from the memory.
 22. Thecomputer-readable storage medium of claim 12, wherein persist the objectin the cache comprises: set a page randomly saved bit associated withthe object.
 23. A computing system comprising: a processor; memory; abuffer pool maintained in the memory; and a buffer management moduleoperable by the processor and configured to: determine a fraction ofpages of a table to persist in the buffer pool; generate a random numberas a decimal value in a range of 0 to 1 for each page of the tablecached in the buffer pool; if the random number generated for a page isless than the fraction, persist the page in the buffer pool; and if therandom number generated for the page is greater than the fraction,include the page as a candidate for eviction from the buffer pool. 24.The computing system of claim 23, wherein persist the page in the bufferpool comprises: associate the page with a non-zero weight.
 25. Thecomputing system of claim 24, wherein include the page as a candidatefor eviction from the buffer pool comprises: associate the page with azero weight; and add the page to a victim list, wherein pages to beevicted from the buffer pool are chosen from pages in the victim list.26. The computing system of claim 25, wherein determine a fraction ofpages of a database table to persist in the buffer pool comprises:determine a first fraction of pages of a database table that can bepersisted in the buffer pool; determine a second fraction of the firstfraction of pages; and multiply the first fraction with the secondfraction.
 27. The computing system of claim 26, wherein the secondfraction of the first fraction of pages is determined based at least inpart on feedback from a previous page reuse rate of the buffer pool. 28.The computing system of claim 27, wherein associate the page with anon-zero weight further comprises: mark the page with a bit indicatingthat the page is associated with the non-zero weight; and increment afirst counter indicating that the page is associated with the non-zeroweight.
 29. The computing system of claim 28, wherein the buffermanagement module is further configured to: determine that a reused pagefound in the buffer pool is associated with the non-zero weight; andresponsive to determining that the reused page is associated with thenon-zero weight, increment a second counter to indicate that page reuseoccurred.
 30. The computing system of claim 29, wherein the buffermanagement module is further configured to: determine whether a value ofhits on pages with non-zero weights divided by a total amount of pageswith non-zero weights falls within a predefined range; and responsive todetermining that the value does not fall within the predefined range,modify the second amount of pages that is cached in the buffer pool. 31.The computing system of claim 23, wherein the buffer management moduleis further configured to: determine a likelihood of the table beingre-scanned; and adjust the fraction of pages of the table to persist inthe buffer pool based on the determined likelihood.
 32. The computingsystem of claim 23, wherein generate a random number as a decimal valuein a range of 0 to 1 for each page of the table cached in the bufferpool further comprises: determine, for a page of the table, a cost ofaccessing the page from the table; and generate a weighted random numberbased on the cost of accessing the page from the table.
 33. Thecomputing system of claim 23, wherein persist the page in the bufferpool comprises: set a page randomly saved bit associated with the page.34-35. (canceled)